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Quantizing noise in delta modulation systems falls into two categories, 
granular noise and slope overload noise. Granular noise exists because the 
decoded output signal can assume only a specified number of levels in the 
range of interest. Slope overload noise occurs when the slope of the input 
signal is greater than the delta modulator is capable of reproducing. When 
the S/N ratio is not too small, the noise power from these two sources is 
additive. 

A formula for the slope overload noise power for Gaussian input signals 
is derived. This is used with an earlier result for the granular noise to give 
over-all signal-to-quantizing -noise ratios. It is shown by computer simula- 
tion that the assumptions employed in deriving these signal-to-quantizing- 
noise ratios are valid and that the analytical results provide good estimates 
of the true values of these ratios. Computer simulation of the Picturephone* 
visual telephone, a low-bandwidth television system, illustrates that the 
formulas derived for Gaussian signals apply quite well to video signals. 
Estimates are given for the S/N ratios theoretically possible when a 4-5-mc 
monochrome television signal is transmitted by delta modulation. 

The characteristics of delta modulation quantizing noise may cause it to 
be subjectively less annoying than an equivalent amount of additive Gaus- 
sian noise. 

I. INTRODUCTION 

Del tu modulation (AM) is one way in which an analog signal may be 
converted into pulses suitable for transmission over binary channels. 
Since the modulation process may be simpler and cheaper for AM 
than for standard pulse code modulation (PCM), there is considerable 
interest in determining how the performance of AM relates to that of 

* Picturephone is a service mark of the Bell System. 
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standard PCM. Digital transmission of an analog signal is one way 
to effectively trade bandwidth for noise immunity in the transmission 
medium. Indigenous to this trade, however, is the introduction of 
quantizing noise in the encoding and decoding processes. Bennett 1 has 
studied this problem for standard PCM. De Jager 2 and Van de Weg 3 
have studied quantizing noise for AM, but their results are somewhat 
restricted due to the difficulties encountered in analyzing a nonlinear 
feedback system such as AM. Zetterberg 4 discusses AM through the 
discipline of information theory. 

This study was initiated primarily to determine what kind of per- 
formance could be expected if AM were used for narrow-band television 
signals such as Picturephone signals, but more general results are also 
presented. The metric used as a figure of merit is the ordinary signal- 
to-quantiz.ing-noise ratio S/N. Recently, the concept of delta modula- 
tion has been subject to a rash of embellishments and modifications, 
some of which may improve its ability to transmit television signals 
and all of which add equipment complexity. This study, however, is 
limited to the simplest type of single-integration AM system with a uni- 
form constant step size. Formulas for S/N ratio are found which apply 
when the S/N ratio is large, which is the region of greatest interest. 
The formulas derived apply to Gaussian signals with arbitrary spectra. 
The results are verified by simulating various AM systems on an IBM 
7094 digital computer and analyzing their performance with Gaussian 
input signals. A practical AM system designed for the transmission of a 
Picturephone signal is simulated, and the results illustrate that the 
formulas derived for Gaussian signals apply quite well to monochrome 
television signals. 

II. THEORY 

Delta modulation is a simple type of predictive quantizing system. Bi ° 
This means that the value of the signal is predicted at each sample time 
and only the difference between the actual signal value and this pre- 
dicted value is transmitted. At the receiver, the value of the decoded 
signal at every sample time is predicted to be the same as that at the 
previous sample time. At each sample time, the transmitted signal is 
simply a correction which, when added to the decoded signal at the previ- 
ous sample time, gives (to an approximation) the signal at the current 
sample time. Systems of this kind are also called differential feedback 
PCM systems. 

The basic single integration AM system is shown in Fig. 1. The adder 
and delay element in the feedback loop around the quantizer simply 
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Fig. 1 — Basic binary AM system. 

form an accumulator. The transfer function of the feedback loop is 
D/(l — D) where D is the unit delay operator e~ ST and represents a 
delay of one sample interval r. Since 

D/(l - D) = D -f-Z) 2 + D 3 ••• , 

the signal being fed back is simply the sum of all previously transmitted 
samples. It is also identical to the decoded signal at the receiver and 
represents the signal value predicted for the next sample time. The 
difference between the input signal and this predicted signal is quantized 
and transmitted through a discrete channel. In practice, it is necessary 
to insert a leak, or amplifier with gain less than one, in the feedback loop. 
Systems with leak are discussed in Section VII. 

For the most part we restrict ourselves to 2-level quantizers whose 
outputs can assume only the levels ±k, where k is called the step size. 
In this paper, the term delta modulation (AM) when used without qualifi- 
cations implies a 2-level quantizer. The extension of our results to multi- 
level quantizers is simple and is covered in Section X. Systems with 2- 
level quantizers are of greater practical interest because, in this case, the 
equipment required for AM is simple and cheap compared to standard 
PCM systems. Since the quantizer levels are ±fc, the decoded output 
before filtering Y(t) can assume the values ±ik, i = 1,2, • • ■ . 

We assume that the input signal x (t) has zero mean, unit variance, and 
is bandlimited to the frequency band (0,/ o ). The sampling rate /, is 
typically many times the bandwidth and, for a 2-level system, is identical 
to the bit rate. 

In AM systems there are two types of quantizing noise, granular noise 
and overload noise. Granular noise is similar to the quantizing noise of 
PCM. It is caused by the fact that the output samples can assume only 
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/ 

discrete values which in AM are multiples of the step size k. Overload 
noise is a result of the fact that the maximum slope a AM system may 
reproduce is limited to kf s . 

Typical signals in a AM system are shown in Fig. 2. Y(t) is the re- 
constructed output signal before filtering. The noise is defined as 



n(t) = x(t) - y(t), 



(1) 



where x(t) is the input signal and y(t) is the output signal. In the 
example illustrated in Fig. 2 the noise n(t) is granular before time t . 
At time t the slope of the input x(t) exceeds that which the delta 
modulator is capable of transmitting. The period of slope overload in 
the case shown is from t to h and the noise during this period is 

n (t) = x (t) - [y(t ) + {t - t )Xo] t ^t^h, 

where xj = kf a is the maximum slope the delta modulator is capable 
of reproducing. 

The quantizing noise is not independent of the signal. Fig. 2 illustrates 
that granular noise is determined by the instantaneous amplitude of the 
input signal and overload noise is determined by the slope of the input 
signal. For very large step sizes almost all of the noise is granular. As 
the step size is decreased the output signal loses its ability to rise and fall 
rapidly and overload noise becomes dominant. As the step size ap- 
proaches zero so does the output y(t). Due to the definition in (1) the 
noise n(t) approaches the signal x(t) and the S/N ratio, which is 10 
log x 2 /ri?, approaches zero db as the output y(t) approaches zero. 
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-*| k-T = l/f 



TIME ■ 



Fig. 2 — Signals in a AM system. 
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Clearly, this definition of the noise and of the S/N ratio must be used 
with discretion when the S/N ratio is small. 

Any plot of S/N ratio versus step size will show a general tendency 
to approach the three asymptotes shown in Fig. 3. In Appendix A, 
S. O. Rice has computed an approximation for slope overload noise 
No for Gaussian input signals. This approximation is valid only when 
the maximum slope xj is somewhat larger than the mis value of x (t). 
In a previous paper 3 Van de Weg has found an approximation for the 
granular noise N , and his expression for N g is used in this paper. If 
the overload noise is small it occurs in short bursts. During a burst, the 
overload noise is the dominant source of noise. When there is no over- 
load burst all noise present is granular noise. The total noise power AT 
can, therefore, be approximated by the sum of N and N g . If we normalize 
our results so that the rms value of the input x(t) is unity, then our 
approximation for the total noise power is 
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Fig. 3 — Asymptotes for S/N ratios in AM for/, »/„ . 
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where 

/, = sampling frequency 

F. = f„/f = sampling frequency as a multiple of the bandwidth f 

a n = \f/(n/f B ) where ^(t) is the autocovariance function of x(t) 

k = step size 

b = variance of x (t) 

62 = variance of x"(t). 
Equation (3) is obtained by substituting fjc for x ' in (22) of Appendix 
A. Equation (4) is taken from page 382 of Ref. 3. These equations 
show thai the noise power is a function of the power density spectrum 
of the input signal x(t) since b , 6 2 , and \f/(r) are determined by this 
spectrum. Since (2), (3), and (4) apply to an input signal with an rms 
value of 1 , the rms signal to rms noise ratio in db is S/N = — 10 log™ N. 

III. FLAT BANDLIMITED GAUSSIAN SIGNALS 

For flat signals bandlimited to (0,/ o ) the expressions for b a and h* , 
which are computed from (17) in Appendix A, and \J/(t) arc 



,2 



b = 
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3 

(2x/ ) 4 



, (r) _rfa*& (5) 

27TJ T 

Fig. 4 shows plots of S/N ratio for a flat bandlimited Gaussian input 
signal. Points from some simulated delta modulation systems are also 
illustrated. Sampling rates of 4, 8, 16, 32, and 64 times the bandwidth 
are shown. The S/N ratios are plotted as a function of the quantity 
kf,/f„ = kF, which, for any given sampling rate, may be thought of as 
the normalized step size. As an example of the use of these curves, we 
see that for a sampling rate of 32 times the bandwidth the maximum 
S/N ratio is about 29 db and it will occur when the step size is about 
12/32. If the rms value of the input signal were not 1 but a then, of 
course, the maximum S/X ratio of 29 db would occur when the step 
size is 12cr/32. To the left of the S/N peaks the noise is primarily over- 
load noise N while to the right of these peaks the noise is primarily 
granular noise N g . The optimum value of kF s maximizes the S/N ratio 
by providing the proper balance between iV and N . 



DELTA MODULATION QUANTIZING NOISE 



123 




4 8 16 32 64 

NORMALIZED STEP SIZE = k F, 



128 256 



Fig. 4 — S/N ratio for bandlimited flat Gaussian signals showing theoretical 
curves and results of computer simulation. (F, = f,/f is the ratio of sampling 
frequency to bandwidth.) 



IV. RC SHAPED GAUSSIAN SIGNALS 

If a flat Gaussian signal bandlimited to the frequency range (0,/ o ) 
is passed through a low-pass RC filter, then the one-sided power spec- 
trum of the output is 

*"(/) = 2 /o_r\ X , n J 9 , , < / < f„ , 



tan" 



■■ e?) x ( " 



2tt/) 2 + a 2 



(6) 



where we assume a mean square value of unity and a = 1/RC. The RC 
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spectrum given by (6) is relatively flat from/ = to a corner frequency 
f c = a/2-ir at which it rolls off to assume a slope of —6 db/octave up to 
the cutoff frequency f„ . It is shown in Appendix B that if a is small 
enough then we may approximate the autocovariance function f (r) by 



feggfe + ■»»> -1) 



IT —CtT _ 

rtO-L. ±-£J£ — --- rgO, _ 

TT a_ (7) 

2 2tt/ 
*(— r) = *(t). 

The values of b and fr 2 for this RC Gaussian signal are found from (17) 
to be 

2ir/ « 2 

*■" _./2r/.\ "' (8) 
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*" 3tan-(^) +a ' (9) 

Using the above expressions we can find the S/N resulting when an RC 
shaped signal is transmitted through a AM system. Figs. 5 and 6 show 
S/N versus kf./f„ = kF, for a = 0.25 /„ and a = 0.068 f , respectively. 
These values for a were chosen because this causes the signal spectra 
to have roughly the same shape as the envelope of a Picturephone signal 
(using current standards) and a black and white entertainment TV 
signal (FCC standard), respectively. We assume here that the Picture- 
phone signal would be bandlimited to 375 kc before encoding. Computer 
analysis of a composite video signal with current Picturephone stand- 
ards indicates that the Picturephone spectrum has a corner at about 

0.25 X 375 kc/2T ££ 15 kc. 

In the U.S., standard entertainment black and white TV is approxi- 
mately bandlimited to 4.5 mc and has a corner at about 0.068 X 4.5 
mc/27r £ 49 kc* These corner frequencies are slightly dependent on 
picture material. Although television signals have strong periodic com- 
ponents, the frequencies involved are so low that their periodic nature 
does not influence the S/N ratio. The spectrum of the quantizing noise, 
however, is affected by this periodicity, for, in general, periodic sampling 
of periodic signals produces quantizing noise which has periodic com- 

* An unpublished study by W. N. Toy shows that this corner frequency may 
lie between 40 and 60 kc depending on picture material. 
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Fig. 5 — S/N for TiC shaped Gaussian signals with a = 0.25 f . 

ponents. Although Figs. 5 and 6 apply specifically to Gaussian input 
signals, they give estimates of the performance of basic AM systems 
when used to transmit Picture-phone signals and standard TV signals 
respectively. Fig. 11 which compares four of the curves in Fig. 5 with 
a computer simulation of an actual Picture-phone visual telephone sys- 
tem using typical picture material shows that these estimates are good 
ones. 



V. COMPARISON OF PCM AND AM FOR GAUSSIAN INPUTS 

In Fig. 7, the S/N ratios for standard PCM and optimum basic AM 
systems with Gaussian input signals are compared. Bennett 1 showed that, 
under conditions usually encountered in practical systems, the rms 
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Fig. 6 — S/N for RC shaped Gaussian signals with a = 0.068 /„ . 



value of the quantizing noise for Nyquist rate sampled PCM is E /-\/l2 
where E is the step size. If n, the number of quantizing digits, is not 
too small, then E is equal to E p /2 n , where E p is the peak-to-peak value 
of the incoming signal. Therefore, the rms S/N ratio in db for PCM is 



(i^) 



D = 20 log ( — V12 ) + 20 log 2", 

where ajE v is the ratio of the signal's rms value to its peak value. 
If we encode only the values of the signal which lie between — 4er and 
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Fig. 7 — ■ Comparison of AM and standard PCM for band limited Gaussian signals. 

4<r and neglect values outside of this range then E p = 8<r and the formula 
for S/N ratio in db becomes 



D 



-7.3 + (in. 



This is called 4o- loading. Although 4o- loading is used for comparison 
in Fig. 7, this is not optimum loading. For PQM, the loading which gives 
the highest value of S/N is dependent on the number of digits, n, used 
to encode each sample value. PCM with a fixed amount of loading 
(regardless of n) provides a realistic comparison with AM in systems, 
such as television, where no amplitude overload is allowed. For other 
applications, however, restricting the PCM system to a fixed amount 
of loading may not provide a valid comparison between PCM and AM. 

Although the curve shown in Fig. 7 for PCM is continuous, it is 
actually defined only when the bit rate is an even multiple of the band- 
width because we have assumed that the sampling rate is always twice 
the bandwidth. 



VI. COMPUTER SIMULATION WITH GAUSSIAN SIGNALS 

The basic AM system of Fig. 1 was simulated on an IBM 7094 digital 
computer and the resulting S/N ratios arc shown as points on Figs. 4, 
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5, and 6. Flat bandlimited signals sampled at the Nyquist rate were 
easily simulated by simply using independent random numbers with a 
Gaussian distribution and unit variance. For convenience, we assumed 
that /o = 1. A flat signal sampled at R times the Nyquist rate is simu- 
lated by filtering the random samples with a digital filter whose cutoff 
frequency is l/R. A discussion of sampled data filters is given in Ref. 7. 
Digital sharp cutoff niters, like their continuous counterparts, are not 
easily realized. The filters used all had the general shape given in Fig. 8. 
The filter shown is down 3 db at 0.25 and we call the bandwidth 0.25 
for this reason. This filter would be used when simulating AM systems 
whose sampling frequency is 8 times the bandwidth (4 times the Nyquist 
rate). Other filters used had exactly the same shape when plotted on a 
log scale but, of course, had different 3-db points. These low-pass filters 
were nonrecursive filters which were simulated by finding a sequence of 
numbers which represented the filter's impulse response. Filtering was 
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Fig. 8 — Power spectrum of low-pass filter with a bandwidth of 1 /» or | f g 
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accomplished by convolving the samples representing the signal with 
this sequence. 

The RC shaped signals were simulated by passing the random sam- 
ples representing flat noise through a digital simulation of a low-pass 
RC network. 



VII. SIMULATION OF THE PICTUREPHONE SYSTEM 

The basic AM system shown in Fig. 1 is impractical because errors 
introduced in the transmission medium will not decay out. To prevent 
the accumulation of errors from severely degrading the signal and to 
improve the operation of the system even when no errors are present, 
it is necessary to place a leak in the feedback loop represented by an 
amplifier with gain /3 less than unity. The AM system with leak added 
is shown in Fig. 9. This system was simulated on the computer and a 
signal similar to the Picturephone signal was encoded and decoded by it. 

The input signal used was a television-like signal obtained by scanning 
a square slide with a slow-speed flying spot scanner, sampling the out- 
put, and encoding the samples into 11-bit PCM. The PCM samples 
were recorded on magnetic tape suitable as an input to the IBM 7094 
digital computer. 8 The sampling frequency was synchronous with the 
line frequency. The slide used to produce the signal was a head and 
shoulders view of a girl similar to what might be expected on a Picture- 
phone call. In this way, a signal was produced which represented a 
Picturephone signal. Current standards for the Picturephone system 
produce a 271-line picture with 2-to-l interlace. The frame rate is 30 
per second. The horizontal and vertical blanking pulses are 21 and 1000 
/xsec, respectively. The simulated signal was subjected to filtering so 
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Fig. 9 — AM system with leak 0. 
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that it was equivalent to a Picturephone signal which had been passed 
through a sharp cutoff filter with a bandwidth of 375 kc. The band- 
width then is considered to be 375 kc and sampling at R times the band- 
width means sampling at a rate of R X 375 X 10 3 samples per second. 

The power spectrum of the composite signal (video and blanking 
pulses) on tape was found by computing the Fourier transform of its 
autocovariance function. The envelope of the power spectrum could be 
roughly approximated by the spectrum of (4) with an a of about 0.25. 
The spectrum, however, had the irregularities typical of a TV signal. 

The slope overload produced by AM for smaller step sizes, occurs 
primarily during blanking intervals, and is not visible on the picture 
tube. For this reason, S/N ratios were found both for the composite 
signal and for the video part of the signal. In the region of interest, the 
S/N ratios for the video part of the signal are a few db above those for 
the composite signal. 

Fig. 10 shows S/N ratios obtained from the simulation using the 
Picturephone signal on magnetic tape. The scale on the left of Fig. 10 
gives rms composite signal to rms noise ratios. The scale on the right 
of Fig. 10 gives peak-to-peak composite signal to rms noise ratios 
because this is the quantity usually measured in television systems. 
The peak-to-peak composite signal to rms noise ratios are 11.6 db greater 
than the rms signal to rms noise ratios because the peak-to-peak value 
of the composite signal used is 11.6 db greater than its rms value. 
The relationship between three metrics associated with the input are 
as follows: 

relative value db 

peak-to-peak of composite signal 3.79 11.6 

rms of composite signal 1 

rms of video part of signal 0.512 —5.8 

For each sampling rate in Fig. 10, there are two curves. In the solid 
curves the rms value of the noise in only the video part of the signal is 
used. The dotted curves use the rms value of the noise in the whole 
composite signal (video plus sync). Using only the noise in the video 
part leads to a better metric of picture quality because, as long as sync 
is maintained, noise in the sync pulses does not degrade the resulting 
television picture. 

In Fig. 10 the actual bit rates are shown. For example, a bit rate of 6 
megabits means sampling at 16 times the bandwidth since 16 X 375 X 
10 s = 6 X 10 6 . The S/N ratios of the video signal varied only slightly 
with leak factor, /3, as long as /3 was near 1. The values of /3 used were 
those which gave the best S/N ratios. These values are shown on Fig. 10 
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Fig. 10 — Simulated Picturephone systems. (Scale on the right assumes a signal 
whose peak-to-peak value is 11.0 db higher than its rms value.) 



and also apply to the points on Fig. 1 1. It will be shown in a subsequent 
paper 9 how the optimum value of 13 is related to the covariance between 
adjacent sample values. 

For the video, the optimum step sizes yielded peak-to-peak signal 
to rms noise ratios of 48.0, 40.8, 32.5, and 23.7 db for sampling rates of 
16/ (6 mb), 8/ (3 mb), 4/.(1.5 mb), and 2/ o (0.75 mb), respectively. 

Fig. 11 was plotted to show the close agreement of the simulated 
Picturephone video results (with leak) to the theoretical results (without 
leak) for RC Gaussian signals with the same spectrum envelope as a 
Picturephone signal (a = 0.25 /„). The points in Fig. 11 are the same 
as those in Fig. 10 connected by the solid curves. They have been trans- 
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2 4 

NORMALIZED STEP SIZE = KF S 

Fig. 11 — Comparison of simulated Picturephone video signals (points) to 
theoretical Gaussian results (solid curves) for a = 0.25/,, . 

lated vertically by 5.8 db because the mis value of the video is 5.8 db 
less than the rms value of the composite signal, and they have been 
shifted to the right by a factor of 1/0.512 because the normalized step 
size is expressed in terms of the rms value of the signal. In previous 
figures, the rms value of the signal meant the rms value of the composite 
signal which is 1, but in Fig. 11 we are dealing with the rms value of 
the video which is 0.512. 

In Fig. 12, the peak-to-peak composite signal to rms noise ratios for 
the simulation of AM are compared with those for standard PCM sys- 
tems. For n-digit standard PCM, the ratio of peak-to-peak signal to 
rms noise in db is 

D vv = 20 log Vl2 + 20 log 2 n 

« 10.8 + Gw. 

In PCM, about 3 db can be gained by assigning only one or two levels 
to the sync pulses and using the remaining available levels to encode the 
video part of the signal. This has not been taken into consideration 
in the above formula or in Fig. 12. 
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Fig. 12 — Comparison of simulated AM Picturephone system to standard PCM. 

VIII. ESTIMATES OF s/n RATIOS FOR AM OF ENTERTAINMENT TELEVISION 

The curves of Fig. G allow us to obtain a rough estimate of the S/N 
ratios possible for monochrome entertainment television systems (FCC 
standard). For the Picturephone signal used in the simulation, the rms 
video was 17.4 db below the peak-to-peak value of the composite signal. 
A comparison between Picturephone standards and entertainment tele- 
vision standards suggests that this is also a reasonable number for 
entertainment television. Moreover, since this number is dependent on 
picture material, we can rest comfortably in the knowledge that we can 
surely find a picture whose rms video is 17.4 db below its peak-to-peak 
value. It should be possible to transmit such a picture with peak-to-peak 
composite signal to video rms noise ratios of about 54, 46, 38, and 29 db 
at bit rates of 16, 8, 4, and 2 times the bandwidth, respectively. These 
ratios were found by adding 17.4 db to the peak values of the curves in 
Fig. 6. 

IX. INTERPRETATION OF s/N RATIOS FOR TELEVISION SYSTEMS 

It is well known that the quality of a television picture cannot be 
judged by its S/N ratio alone. In fact, such a judgment may be quite 
misleading. The quality of a picture contaminated with additive flat 
Gaussian noise may be quite different from that of the same picture 
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contaminated by AM quantizing noise even if the S/N ratios are iden- 
tical. 

Quantizing noise in standard PCM exhibits itself in television pictures 
as contouring. If the number of digits used is high enough, typically 7 or 
8 for monochrome entertainment television, then the eye cannot detect 
contouring and no degradation due to quantizing noise is noticeable. 
In AM, quantizing noise in television signals exhibits itself subjectively 
in four ways — as grainy noise, slope overload, contouring, and edge 
busyness. The fact that the noise is present in four subjectively different 
forms may be u significant advantage for A.M. An observer normally 
judges the quality of a television picture by the most severe degradation 
that he sees rather than by jointly considering several different types 
of degradation. AM takes advantage of this. In a subjectively optimum 
AM system the step size, sampling rate, and filter characteristics are 
chosen to spread the degradation into these four categories to produce 
the best subjective picture. In earlier computations, we considered all 
noise to be either granular noise N g or overload noise N„ . In this section, 
we have further divided granular noise into three different categories 
grainy noise, contouring, and edge busyness — because this N g exhibits 
itself as three subjectively distinguishable phenomena. Granular quan- 
tizing noise tends to have a rectangular amplitude distribution and is 
likely to be less annoying than an equivalent amount of additive noise 
with a Gaussian amplitude distribution. 

Slope overload noise will appear subjectively like a loss of bandwidth 
since the rise time of white to black transitions is increased. The snow 
or salt and pepper effect so ubiquitous in TV systems is what we are 
calling grainy noise. Contouring occurs since there are only a finite 
number of steady levels or flat tones which can be established by a AM 
system (if the leak /3 is unity the number of levels is one less than the 
peak-to-peak value of the signal divided by the step size). Edge busyness 
exhibits itself as a busyness at vertical edges, i.e., vertical white to black 
transitions, when the sampling rate and line rate are not synchronized. 
Due to the lack of synchronization and the finite time between samples 
these transitions do not occur in a straight line on successive lines and 
frames. 

X. MULTI-LEVEL QUANTIZING 

If the quantizer shown in Fig. 1 is not a 2-level device, then the 
formula for N„ in (3) must be modified. If we define an n-digit uniform 
quantizer to be one which quantizes its input into the nearest one of the 
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2" levels ±/r, ±3fc, ••• , ±(2" — 1 )A-, then overload noise does not 
occur until |«'(0I becomes greater than (2" — l)kf„ . To modify N„ 
in (3) then to accommodate a uniform n-level quantizer we simply 
replace k by (2 n — \)k. The expression for N g does not need to be 
modified . 

XI. SUMMARY AND CONCLUSIONS 

An analytical solution for the S/N ratio as a function of step size and 
bit rate is presented for a signal with an arbitrary spectrum and Gaussian 
amplitude distribution. The correctness of the solution has been demon- 
strated by computer simulation of some delta modulation systems. 
Computer simulations with low bandwidth television signals have shown 
that the formula is accurate for actual video signals whose amplitude 
distribution is not necessarily Gaussian. These analytical results will 
allow us to predict what values of S/N ratio may be obtained at various 
bit rates for many types of signals. 

Some computer simulations demonstrated that properly designed 
AM systems can transmit 375-kc Picturephone signals with peak signal 
to rms noise ratios as high as 24, 32, 40, and 48 db for bit rates of 2, 4, 
8, and 16 times the bandwidth, respectively. Estimates of the S/N 
ratios possible for 4.5-mc black and white entertainment television are 
about 29, 38, 4(i, and 54 db for the above bit rates, respectively. These 
S/N ratios are somewhat dependent on picture material. Although S/N 
ratios are an important indicator of system performance, final judg- 
ments about a system's ability to transmit television pictures must he 
based on subjective viewing tests. 

The quantizing noise in television AM systems distributes itself into 4 
visually distinguishable categories. This suggests that AM quantizing 
noise may be subjectively less objectionable than an equivalent amount 
of noise introduced by other means. 

Any comparison between the relative performance of AM and stand- 
ard PCM depends on the characteristics of the signal to be transmitted. 
Generally, however, for signals whose spectra decrease with frequency, 
AM is superior by the S/N criterion to standard PCM when low quality 
reproduction of the signal is allowed. For high-quality systems, standard 
PCM gives better results than AM. This is due to the fact that in AM 
doubling the bit rate gives only about an 8-db gain in S/N ratio. In 
standard PCM, increasing the number of bits per sample by 1 increases 
the S/N ratio by 6 db. The relative performance of AM and standard 
PCM for two types of signals is illustrated in Figs. 7 and 12. 
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APPENDIX A* 

Noise Burst, Steep-Slope A pproximation to A-Modulation Noise 

When the step size is not too large, most of the output noise in a delta 
modulation system is produced in bursts. The bursts occur when the 
time derivative of the input exceeds the maximum slope permitted by 
the system. An approximation for the average value of the power in 
this type of noise is given here. It turns out that the analysis is quite 
similar to that used to study the distribution of fade lengths in radio 
transmission (see (1) of Ref. 10). 

The material given here was worked out jointly by Mr. O'Neal and 
myself. The concepts and approximations associated with the delta 
modulation system are due to him. My part consisted chiefly in supply- 
ing the steps suggested by the analogy with the fading problem. 

The problem is the following. Let the input voltage be a Gaussian 
process x(t) with (one-sided) power spectrum F(f). Let the output of 
the system be y(t). Most of the time y(t) will be equal to a: ft). During 
intervals of this sort, the absolute value of a;' ft) = dx(t)/dt is less than 
some given positive quantity xj. The intervals during which 7/ ft) ^ x(t) 
start at the instants | a:' ft) | increases through the value x ' . Let t denote 
the starting time of a particular interval of this type and suppose, for 
convenience, that x' (to) is positive so that x (t ) = x„ . Throughout the 
interval y(t) is denned to be x{t ) + ft - lo)x ', and increases linearly 
with time. The interval lasts as long as x(t) exceeds y(t). It ends at 
time U when x(t) and y(t) again become equal; 

at ft,) = ,j( (x ) = x {t„) + ft, - /„).»•;. (lo) 

For intervals starting with x ' (t ) = -xj, y(t) is defined similarly by 
y(t) = x(t ) - (t - t )xo. 

The output noise is defined to be 

n{t) = x(t) - y(t). (11) 

* This appendix was written by S. O. Rice. 
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Since n(t) will be zero much of the time, the noise tends to occur in 
short bursts. The average noise power is 

1 pT 

»«(0 = lim ^ / n*(0 di. (12) 

We seek an approximation for n^{t) which holds when x is large com- 
pared to the rms value of x (t). 

When x is large, the interval ti — t Q tends to be small and an ex- 
pression for its length may be obtained by considering the expansion of 
x(t) about t . Here, and in much of the following, we take x (t ) to be 
positive : 

x(t) = x(t ) + (* - U)xJ + {i ~ to)2 x"(to) 



2! 



H oj — x Uo) + 



(13) 



= ^^^'(O +*LZL<V"a) • • •) (14) 

^-^-.TO + --" (15) 

In going from the first equation to the second we have set t = h and 
used the end-of-interval relation (10). When x„ is large we can expect 
x" (t ) to be large and negative while x" (t ) remains of order 1. This is 
shown in the following paragraph. 

To begin with, consider the special case x = sin ut with t near zero. 
Then x and its time derivatives are such that x tt 0, x £d to, x" tt 0, 
x" 7H — a> 3 , etc. Our Gaussian x(t) and its derivatives behave in some- 
what the same way when x (t) is large. Let £ = x'(t), t\ = x"(t), f = 
x (t) denote the first three derivatives at time t of an x(t) chosen at 
random from the ensemble of x(t)'s. It may be shown that their joint 
probability density is 

VP" eXP L~26 ~2b 2 ~- 2^ - 1 J' U6) 

where b and 6 2 are the respective variances of x (t) and x" (t), and 

b„ = f (2irf) n+2 F(f) df, n = 0,2,4 

Jo (17) 

B — b bi — hi 

where F(f) is the power spectrum of x(t). When x (t) is held fixed at 
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the large value x ' , (16) shows that the average value of x" (t) 
is — b 2 x '/b . If Xo is so large that t his average value is large compared 
to the standard deviation \/B/b , we are led to approximate x" (t) in 
expression (15) in the interval h — t by its average value. Making the 
further approximation of neglecting the higher order terms in (15) gives 

„-«,««££> (18) 

for the length of the interval during which x(t) exceeds the output y(t). 
The noise energy in the burst corresponding to the interval h — t is 

f 1 n-(t) dt = ^ [x(t) - y(t)f dt 

= /" [x(t) - x(to) - (t - t„)x 'f di 



/'TlL^Vw + ^l>(t)] 



2 

dt 



(19) 



81 

140 \b 2 Xo 



_ , , ,x"(t )]\ 



In going to the last line, the approximation (18) for h — t is used and 
x" (t ) is replaced by —b 2 x '/b o . It is helpful to make the change of 
variable t — t = (ti — t )z. 

Expression (19) gives the noise energy in a burst for which the initial 
value of x"(t) is equal to x"{t ). As we go from burst to burst, x" (t ) 
will fluctuate but it will always be positive for the type of interval 
(x (t ) = Xo > 0) we are considering. This is because x (t) is increasing 
as it passes upward through the value x at time t a . 

The next step is to find the average noise energy in a burst. When a 
member x (t) is picked at random from the ensemble of x (t)'s, the chance 
that x (t) will increase through the value x ' during t a , t -f- dt with slope 
between x" and x" + dx" is x"p(x ',x")dx" dt, where 



L 2b 26 2 J 



p( ^ )= VS exp| ;; 

is the joint probability density of x' (t) and x" (t) (see Section 3.5 of 
Ref. 11). When the ensemble of x(t)'s consists of an extremely large 
number M of members, the number which have the above behavior is 
approximately (M dt)x"p(x„',x")dx" . The total number M which pass 
upward through x Q ' during t , t + dt is obtained by integrating from 
x" = to x" = °o : 
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M (Mdt)/b 2 V ( xj' 2 
M ° = ^^ \bj 6XP \-2b 

Since the noise energy in a burst is proportional to x" we average it 
over the M„ members: 

ave.r" 7 = ±- I X "^ M dt)[x" V {xJ ,x") dx"] 
Mo Jo 

= (26 2 ) 7/2 r(9/2). 
Combining this with (19) gives 



ave 



jy^dl-^^Jbf 3 ' 2 (20) 

for the average noise energy in a burst. 

Our final assumption is that a noise burst occurs every time x (t) 
increases through x or decreases through —x . The true number of 
bursts tends to be less than this because such crossings can occur when 
a burst is in progress. From noise theory, 11 the expected number of such 
crossings in one second is 

Multiplying by the average burst energy (20) then gives 

which is the approximation sought for the average noise power. 

The right-hand side of (22) has the dimension of (volt) 2 since the 
dimensions of xj, b a , b 2 , are volt/sec, (volt/sec) 2 , (volt/sec 2 ) 2 , respec- 
tively. 

APPENDIX B 

Computation of \p(r) for a Bandlimited RC Signal 

By a bandlimited RC signal we mean a signal which will result if 
white noise is passed through a low-pass RC filter and then bandlimited 
to the interval (OJ'o). The one-sided power spectrum of such a signal 
with unit variance is 



a tan" 



F{f) = ~ /9 ,-x X , 9 ... , 2 < / < f 



a 

F{f) =0 f^fo. 
where a = 1/RC. 
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The autocovariance function of a bandlimited RC signal with unit 
variance is 



*(r) = t F(f) cos2tt/t df 



+ " = K\ I. &&+*«"'*" (23) 

j[. ( a,/)" + «. cos 2wfT df \ • 



where 



a tan- 1 (2T/ /a) ' 

The first integral can be evaluated by contour integration and is found 
to be (a/4) exp ( — a | t | ). If a is small enough then the second integral 
can be approximated by 

/. (aw? + 3 cos 2 ' /T rf/ 



'/. (2t/) ! + o? 

- a 'Cwf? ms2Tfrdf (24) 

s ^rJ[- cos2^|T| + s . Wa[T|) _|-| 

27T |_ ZTTJo I T| ^J 

Therefore, 
Hr) St K |_ ? e - — - ^ 2j/Jt | + S. (ih* I r I) - 2JJ ■ 

where Si is the sine integral function. The above approximation of \p(r) 
does not have ^(0) = 1 which is the necessary requirement of unit 
variance. To restore this requirement we divide the above expression by 
^(0). Therefore, the autocovariance function for a bandlimited RC 
signal with unit variance may be approximated by 



Hr) S 



(COS 2irf I T I , a- /o /• I IN T \ 

2W.H ' +&W.H)- 5 J 



7T a 

2~ 2Vf„ 



Although the above approximation is convenient for computational 
purposes, an exact expression for \{/(t) can be found. Instead of approxi- 
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muting the second integral on the right-hand side of (23), it can be 
integrated exactly giving 

-£- Im [e~ m Ex{-ar - i2irf oT ) - e aT Ei{a T - *2ir/»], 

47T 

where E\ is the exponential integral. An alternate way of arriving at the 
approximation in (24) is to expand the E x functions in the above ex- 
pression about — ?2tt/ t and take the limit as a becomes small. 
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